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1. Introduction 

The Markov property is a central concept in the classic theory of real-parameter stochastic 
processes. Paul Levy was the first to investigate its extension to processes indexed by a collection 
which is not totally ordered. Hence, he introduced in [30] the sharp Markov property for two- 
parameter processes . A process (Xt) te [ ^ is said to be sharp Markov with respect to a set 

A C [0, l] 2 if the er-fields J- a and Ta c are conditionally independent given Tqa-, where for 
any V C [0, l] 2 , Ty := a({X t ;t E V}). Russo [39] proved that processes with independent 
increments are sharp Markov with respect to any finite unions of rectangles. Furthermore, 
Dalang and Walsh [11, 12] characterized entirely the collection of sets for which all processes 
with independent increments are sharp Markov. 

Since the Brownian sheet was known not to satisfy this property with respect to simple 
sets (e.g. triangle with vertices (0, 0), (0, 1) and (1, 0)), a weaker Markov property named germ- 
Markov has been introduced in [34] . Similarly to the sharp Markov property, a process is said to 
be germ-Markov with respect to a set A C [0, 1] if Ta and T A" are conditionally independent 
given Qqa '■= C\vJ~v, where the intersection is taken over all open sets V containing dA. As 
proved in [39], the Brownian sheet is germ-Markov with respect to any open set. 

A third Markov property, called * -Markov, arises in the two-parameter literature. It has 
been first defined by Cairoli [8], and then widely studied in [36, 28, 33]. In particular, this last 
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paper has established that *- Markov processes satisfy both sharp and germ-Markov properties 
with respect to finite unions of rectangles and convex domains respectively. Moreover, as stated 
in [35, 32, 46], the concept * -transition function can be naturally introduced and leads to a 
complete characterization of the finite-dimensional distributions of R 2 -indexed processes. For 
sake of readability, the precise definition of *-Markov processes is only given in the core of the 
article. 

This overview of the two-parameter Markov literature is clearly not exhaustive and a more 
complete picture is given in the sequel, including in particular the modern multiparameter 
approach presented by Khoshncvisan [26]. 

Recently, Ivanoff and Merzbach [24] introduced a set-indexed formalism that allows to 
define and study a wider class of processes indexed by sets. Based on this framework, several 
extensions of classic real-parameter processes have been investigated, including Levy processes 
[20], martingales [24] and fractional Brownian motion [18, 19]. The study of the Markovian 
aspects of set-indexed processes led to the definition of sharp Markov and Markov properties in 
[25], and the set-Markov property in [5]. The first paper mainly focuses on the adaptation of Paul 
Levy's ideas to the set-indexed formalism. The last approach, also called Q-Markov, introduces 
a stronger property that allows to define a transition system which characterizes the law of a 
set-Markov process. More precisely, Theorem 1 in [5] states that, given an initial distribution, 
if a transition system satisfies a Chapman-Kolmogorov equation (2.10) and a supplementary 
invariance assumption (2.11), a corresponding set-Markov process can be constructed. 

In the present work, we suggest a different approach for the introduction of a set-indexed 
Markov property, called C -Markov. The main goal is to obtain a natural definition of the tran- 
sition probabilities which then lead to satisfactory characterization and construction theorems. 
As presented in the sequel, this new set-indexed Markov property also appear to be a natural 
extension of some existing multiparameter Markov properties. 

In order to introduce the definition of C -Markov processes, let first recall the notations used 
in the set-indexed formalism. We consider set-indexed processes X = {Xa; A G A}, where A is 
an indexing collection composed of compact subsets of a locally compact metric space T, and 
which is assumed to satisfy the following conditions: 

(i) A is closed under arbitrary intersections and A° ^ A for all A € A, A ^ T; 
(ii) 0' := Has.4 A is a nonempty set (it plays a role equivalent to in R+ ); 
(Hi) there is an increasing sequence (-Bn)neN of sets in A such that T = U n< =isiB n : 
(iv) Shape hypothesis: for any A, A±, . . . , A^ £ A with A C U^ =1 Ai, there exists i £ {1, . . . , k} 
such that A £ Ai. 

For sake of readability, we restrict properties of A to those required for the development of the 
C-Markov approach. Supplementary assumptions such as separability from above will be added 
in the sequel when necessary. In addition, the complete definition of an indexing collection can 
be found in [24] . Finally, we remind that the set-indexed formalism embraces the multiparameter 
setting through the indexing collection A — {[0, t] ; t £ R+ }• 

The notations A(u) and C respectively refer to the class of finite unions of sets from A and 
the collection of increments C = A\B, where A £ A and B £ A(u). According to [24] and since 
the assumption Shape holds on A, there exists a unique extremal representation {Aj}i<j<fc of 
any B £ A(u), i.e. such that B = uf =1 A; and for all i ^ j, Ai £\ Aj. Therefore, in the sequel, 
to any increment C £ C is associated the unique A £ A and B = U* =1 Ai such that C = A \ B, 
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B C A and {Ai}i<k is the extremal representation of B. 

Then, for any C = A \ B, B = L)f =1 Ai, let Ac denotes the following subset of A, 

Ac = {UeA e ;U£B°}:={U£,--- ,Ug}, where p = \Ac\ (1.1) 

and At corresponds to the semilattice {AiC\- • -dAk, ■ ■ ■ , A\ C\A^, A\ . . . , Ak} C A. The notation 
Xp refers to a random vector Xp = [Xjji , ■ ■ ■ , Xy-p ) . Similarly, xc is used to denote a vector 
of variables (xjji , . . . , X[jp). 

Lastly, for any set-indexed filtration T = {J- a] A £ A}, collections {Fb)b£A(u) an d (Gc)ceC 
are respectively defined by 

Tb ■■= V Ta and G *c ■■= V Fb - ( L2 ) 

AeA.ACB BeA(u),BnC=® 

The family (Gq)c<£C is usually called the strong history. 

We can now introduce the set-indexed Markov property, named C -Markov property, which 
is studied in the present work. 

Definition 1.1 (C-Markov property). Let (fi, J 7 , (Ta)a£Ai P) ^ e a complete probability space. 
An E-valued set-indexed process X is said to be C-Markov with respect to the filtration (J 7 a)a<£A 
if it is adapted to (J 7 a)aeA an d if ^ satisfies 

E[f{X A )\g£}=E[f{X A )\X c } P-a.s. (1.3) 

for all C = A\ B £ C and any bounded measurable function f : E — > R. 

C-Markov processes are first studied in the general set-indexed framework (Section 2). We 
introduce the concept of C-transition system, usually denoted V = {Pc( x c; dx^); C S C}, 
associated to the C-Markov property. It extends in a natural way the classic definition of 
transition operators for one-parameter processes, and in particular, the Chapman-Kolmogorov 
equation which becomes 

VCeC,A'eA; P a f = Pc'Pc«f where C" = Cn A', C" = C \ A' (1.4) 

and / is a bounded measurable function. This notion appears to be well-suited to the C-Markov 
property Indeed, our main result (Theorems 2.1 and 2.2 in Section 2.1) states that on one hand, 
the initial law of X^i and the transition probabilities naturally induced by a C-Markov process 
form a C-transition system which characterizes entirely the finite-dimensional distributions. 
Moreover on the other hand, given an initial measure v and C-transition system V , we observe 
that a corresponding C-Markov process can be constructed on the canonical space. 

As stated in Section 2.2, the C-Markov property has connections with the set-indexed Marko- 
vian literature, especially the work of Ivanoff and Mcrzbach [25]. Nevertheless, we also notice 
that it clearly differs from the Q-Markov approach of Balan and Ivanoff [5]. 

C-Markov processes appear to satisfy several interesting properties (Sections 2.3 and 2.4). 
Theorem 2.3 proves that the natural filtration of C-Markov process verifies a conditional in- 
dependence property. Moreover, classic simple and strong Markov properties can be extended 
to the C-Markov formalism (Theorems 2.4 and 2.6) under an homogeneity assumption on the 
C-transition system, and for the latter, the introduction of the notion of C-Feller process. To 
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illustrate these different concepts, several examples arc given in Section 2.5, including an insight 
of set-indexed Levy processes and the construction of a set-indexed SaS Ornstein-Uhlcnbeck. 

In a second time (Section 3), we focus on specific properties satisfied by C-Markov pro- 
cesses in the multiparameter setting. Thereby, Theorem 3.1 first proves that multiparameter 
C-Fcller processes have a right-continuous modification which is C-Markov with respect to the 
augmented filtration. We observe that the C-Markov approach can be seen as a generalization 
and simplification of the two-parameter *-Markov property Moreover, we also note it embraces 
the recent multiparameter Markov developments presented by Khoshnevisan [26] . Finally, the 
end of the section is devoted to the illustration of the C-Markov property with multiparameter 
processes which often appear in the literature. 



2. Set-indexed C-Markov property 



We begin this section with a few observations and remarks. In this paper are considered E- 
valued set-indexed processes X = {Xa;A € .4}, where (E,cLe) is locally compact separable 
metric space endowed with Borel sigma-algebra £ . 

Since the assumption shape holds on the indexing collection, for any ^4-indexed process X, 
there exists an extension AX of X on A(u) and C, given by an inclusion-exclusion formula, 



AX B :=Y. Xa > ~Y. Xa ^ +--- + (-l) k+1 X Al n-nA k and AX C :=X A -AX L 



In the sequel, it will be assumed that when this extension AX is used, (E,£) = (R d , B(H d )). 

According to Lemma 3.4 in [25] and using notations previously introduced, the extension 
AX on A(u) and C satisfies 



\*o\ 

E 

t=i 



(-irx L 



and 



AXr 



X A 



(2.1) 



where (— l) £i corresponds the sign in front of Xy^ in the inclusion-exclusion formula. In other 
words, equation (2.1) states that every term Xy in the inclusion-exclusion formula and such 
that V ^ Ac is cancelled by another element in the sum. 

As a consequence, we notice that equivalently to Definition 1.1, an Revalued set- indexed 
process X is C-Markov with respect to (J 7 a)agA if for all C € C and for any measurable function 



f-E 



R 



E[/(AX C )|2<5]=E[/(AX C )|X C ] P-a.s. 



Indeed, according to equation (2.1), AXb is measurable with respect to Qq and cr(Xc), and 
therefore, the equality Xa = AXc + AXb and classic properties of the conditional expectation 
induce the equivalence of definitions. 

Finally, the natural filtration of a set-indexed process X is defined by J- a = d({Xv]V C 
A, V £ A}) for all A € A. Filtrations are always supposed to be complete. According to 
Definition 1.1, we observe that any C-Markov process is always C-Markov with respect to its 
natural filtration. 
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2.1. C-transition system: characterization and construction results 

In the light of Definition 1.1 of C-Markov processes, the concept of C-transition system can be 
naturally introduced. 

Definition 2.1 (C-transition system). A collection V = {-Pc(xc; dxA)] C G C} is called a 
C-transition system if it satisfies the following properties: 

1. for any C G C, Pcfec', dxA) is transition probability, i.e. for all xc G E^°\ , Pc(xc; • ) is 
a probability measure on (E,£) and for all Y G £ , Pc{ • ; T) is a measurable function; 

2. for any x G E and Y G £ , P${x; Y) = 8 X (Y); 

3. for anyCeC and A' G A, let C = C (1 A' and C" = C\ A 1 be in C. Then V must satisfy 
the following Chapman- Kolmogorov equation, 

Pc(*c;T)= [ P c ,(x c ,;d^)^c»(x c »;r), (2.2) 
Je 

for all x c G E\ Ac \ , x c / G E^c'l, x c » G E^c"\ and T G £ . 

Let us make a few remarks on Definition 2.1. 

Remark 2.2. Let C = A \ B G C and A' G A. We observe that if A' C B or A C A', we 
respectively have C = or C" = 0, and therefore, equation (2.2) is straight forward since one 
of the term is a Dirac distribution. 

On the other hand, if A' (j- B and A' C A, equation (2.2) is still consistent. Indeed, since 
C" = A \ (A' U B), and A' G\ B, we have A 1 G Ac", and therefore, the variable xa' is one of 
the component of the vector x c » . 

We also note that equation (2.2) implicitly induces that the integral does not depend on any 
variable xy with V Ac, since these components do not appear in the left-term. 

Remark 2.3. In the particular case of T = R+ and A = {[0,t] ; t G R+}, Definition 2.1 
corresponds to the usual definition of a transition system. Indeed, in this particular case, A(u) = 
A and C = {(s,t\ ; s,t G R+}, and thus, V is indexed by R^_: V = {P s j(x; dy); (s,t) G R+}. 
Then, Definition 2.1 corresponds to: 

1. for any s,t G R^_, P s t {x;dy) is transition probability; 

2. for any s G R+, P s ^ s {x,dy) = 5 x (dy); 

3. for any s < s' < t G R+, x G E and L G £, V satisfies P s , t {x; Y) = J E P s , S '(x; dy) P s > ,t{y, Y), 
since using previous notations, C = (s,t], C = (s',t] and C" = (s, s'}. 

Proposition 2.4 proves that Definition 2.1 of a C-transition systems is coherent with the 
C-Markov property. 

Proposition 2.4. Let (O, T, {Ta)a^a-, be a complete probability space and X be a C-Markov 
process with respect to {!Fa)a^a- F° r a ^ C = A\B G C , the collection V = \Pq(-x.c\ dy); C G C} 
is defined by 

Vx c G £?l-*ol,r G £; P c (x c ; T) := P(X A G Y \ X c = x c ). 
Then, V is a C-transition system. 

Proof. Let us verify the three different points from Definition 2.1. 
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1. Clearly, for any C = A\ B G C, Pc(xc; <1xa) is a transition probability. 

2. The equality P®(x;dy) = S x (dy) holds since, (? * = VveA^v and therefore, for any / 
bounded measurable function and all A € A, E[/(Xa) \ GS] = J(Xa)- 

3. For any C = A \ B G C and A' G .4 such that A' C A and A' £ B, let C" = Cn4' = 
A' \ (A' n S) and C" = C\ A' = A\ (A' U B). Then, since C" C C, we note that G* C 
and thus, for all T G £, we obtain 



Pc(Xc;r) = p(x A Gr|^) = p(p(x A Gr|&5„) | Gh) = E[p c »(x c « ; r)|££]. (2.3) 



since C/^ ^c" an< ^ the vec tor X C ' is C/^-measurable (A' B C B). 

As C" = A \ (A' U B), we observe that Xa> is the only term in the vector X C " which is 
not C^-measurable. Therefore, using a monotone class argument, equations (2.3) and (2.4) 
lead to expected equality. 



The next two theorems gather the main result of this section: for any C-Markov process, its 
initial distribution and C-transition system characterize entirely the law of the process. Con- 
versely, from any probability measure and any C-transition system, a corresponding canonical 
C-Markov process can be constructed. To our knowledge, such a result does not exist for other 
set-indexed Markov properties, or at least require some tricky technical assumption in the case 
of Q-Markov. 

Theorem 2.1. Let (SI, J-, (J-a)aeAi P) be a complete probability space and X be a C-Markov 
process with respect to (J~a)aeA ■ 

Then, the initial distribution v of Xqi and the C-transition system V = {-Fb( x c; ^xa)', C G 
C} characterize entirely the law of the process X . 

Proof. We have to express the finite-dimensional distributions of X in terms of v and V . 

Let A\,. . . ,Ai- G A and / : E k — > R + be a measurable function. Without any loss of 
generality, we can suppose that At = {Aq = 0', A\, . . . , Ak] is a finite semilattice with consistent 
numbering, i.e. stable under intersection and such that Aj C Ai implies j < i. 

Let Ci, . . . , Ck G C be the left-neighbourhoods d = Ai\ (UjZgAj), with i G {1, . . . , k}. Since 
At is semilattice, Ac i C At for any i G {1, . . . , k}. 

Then, if we consider the law of (Xa 1 , ■ ■ • , X Ak ) , we obtain 



using a monotone class argument and the Gq -measurability of the vector (Xa ± , ■ ■ ■ , XA k _ 1 )- 



Furthermore, for any positive measurable function h, we have 



E[h(X A >)\Gc] =E[E{h(X A >)\Gc>] \Gc]= [ Pc(*c",teA>)KxA>), (2.4) 



□ 



E[f(X Al ,...,X Ak )}=E[E[f(X Al ,...,X Ak )\G5 k )] 
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Therefore, by induction, we get 
E[f(X Al ,...,X Ak )} 

= E / Pc 1 (XQr,dx Al )Pc 2 (Xc 2 ;dxA 2 )---Pc h (Xc k ]dxA k ) f(xA 1 ,-.-,x Ak ) 

l J E k J 

= / i/(dx )P Cl (x ;dx Al ) Pc 2 (X-c 2 ;dxA 2 ) ■ ■ ■ Pc k (X-c k ;dx Ak ) f(x Al , ■ ■ -,XA k ), 

JE k + 1 

since A Cl = W}- □ 
To obtain the construction theorem, we need the following technical lemma. 

Lemma 2.5. Let consider a C-transition system V = {Pci^c] dx^); C £ C} and two semi- 
lattices A 1 = {A\ = , A{, . . . , A^} and A 2 = {A 2 , = 0', A\ , . . . , A 2 2 } with a consistent 
numbering and such that A 1 C A 2 C A. 

Let C\, . . . , C* £ C and C 2 ,..., C 2 2 £ C be respectively the left-neighbourhoods of A 1 and 
A 2 , i.e. C\ = A\ \ (uj.zJ)Aj) and C 2 = Af \ (li-~oA|). Then, for all x € E and any positive 
measurable function f : E ni t— > R+, V satisfies 

/ ^cj(^;dx A i)P c i(x c i;dx A i)---P c i (x c i ; dx A i ) f(x A ] , ■ ■ ■ , x A i ) 

J Eni 1 2 2 2 1 mi 1 1 

= / p cl{x]dx A i)Pcl{^cl'^ x Al)---Pcl 2 {^cl^ dx Al 2 )f{xA\,---,XAi ii ). (2.5) 

We note that since A 1 C A 2 , every variable Xa 1 has a corresponding term Xa 2 where ji £ 
{1, . . . ,n2j-, which ensures the consistency of the second term of formula 2.5. 

Proof. We proceed by induction on 77,2 . Let k < ri2 be the highest index such that A 2 £ A 2 and 
A 2 A 1 . We denote A 2 ' = A 2 \ {A 2 }. We observe that A 2 ' is scmilattice, since in the contrary, 
we would have A 2 £ A 1 . Let now distinguish two different cases. 

1. We first suppose that for all i £ {k + 1, . . . ,712}, A 2 ^ ■A. c i. Then, we know that for any 
i £ {1,...,??2} \ {£;}, the term x A 2 does not appear in the component Pc i (x C 2 ; Axa 2 ) • 
Therefore, we can integrate the variable over x A 2 , and since J E Pq2 ( x c£ > ^ x A 2 k ) = 1, we 
obtain a formula which corresponds to the case of the semilattice A 2 ' . 

2. We now assume there exist i m > ■ ■ ■ > i\ > k such that A 2 £ A. c z for each j £ {1, . . . , m}. 

3 

Let first suppose that m > 2. 

Then, there exists i £ {1, . . . ,h} such that A 2 a = A? n Af . As A 2 k C Af n Af 2 , we have 
k < i . Furthermore, A? = A\ is not possible since Af^A?, and thus Af o belong to A 1 . 
Thereby, we necessarily have A 2 £ «4. C 2 , which implies io = i\ because of i\ definition. 

Therefore A? C A| 2 . But, since A 2 . C A^, we have 

Cl 2 ■= A 2 2 \ (U^A 2 ) = A 2 2 \ (U^ ¥fe Af). 

Furthermore, we notice that {Af , . . . , A 2 2 _ x } \ {A 2 } is a semilattice (unless we would 
have A 2 £ A 1 ), and is thus stable under intersections. Hence, according to the previous 
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observations, we obtain A c ? C ; < j < «2 and j 7^ fc}, which is in contradiction 
with the assumption A\ £ ■A-c' 2 ■ 

Thereby, we necessarily have m = 1 and without any loss of generality, we can suppose that 
ix = k + 1. The variable 2:^42 only appears in the vector x C 2 and wc only have to consider 

the sub-integral J E P C 2(x. C 2; dxj^) P C 2 +i (x C 2 ; T), for all T £ £. 

Let C £ C be C = A 2 k+1 \ (U^Af ). Wc observe that Cf = C A\ and Cg +1 =C\A\. 
Therefore, we can apply the Chapman-Kolmogorov equation (2.2) and get 

P c (x c ; r) = J e P cl (x Cfc2 ; dx A 2 ) P c , +i (x C 2 +i ; T). 

Finally, if we inject the previous formula in equation (2.5), we obtain an integral which also 
corresponds to the case of the semilattice A 2 . 

Therefore, in both cases, we simplify the integral to get a formula which corresponds to the 
semilattice A 2 = A 2 \ {A 2 }. We proceed by induction, and since the it ends when A 2 = A 1 , 
we have proved the equality (2.5). □ 

Given an initial probability measure and a C-transition system, we now construct a canonical 
C-Markov process. Theorem 2.1 shows how to design the finite-dimensional distributions to 
which apply the Kolmogorov extension theorem. 

In Theorem 2.2, for any indexing collection A, ft designates the canonical space E A , supplied 
with its classic sigma-field J- generated by coordinate applications. X is the canonical process, 
i.e. for all A £ A and u> £ fl, Xa{u) = us {A) and (J-a)a<eA corresponds to the natural filtration 
of X. 

Theorem 2.2. Let V be a C-transition system V = {-Pc( x c! dx a)\ C £ C} and v be a 
•probability measure v on (E,£). 

Then, there exists a unique probability measure on (f2, J 7 ) such that X is a C-Markov 
process with respect to (J 7 a)aeA> with initial measure v and C-transition system, V ', i.e. 

X w ~v and F v {X A £T\g£)=Pc(Xc;T) ¥ v -a.s. 

for all C = A\ B £ C and T £ £. 

Proof. To construct the measure P„, we need to define for any Ai,. . . ,Ak £ A a, probabil- 
ity measure HAi...A k on (E k ,£® k ), such that this family of probabilities satisfies the classic 
consistency conditions. 

1. Let Ai, . . . ,Ak be k distinct sets in A and ir be a permutation on {1, . . . , k}, then 

^...A^Fl X ■■ • X Tfc) = fJ.A w(1) ...A 7l(k) (T 7r (l) x • • • X T n(k) ) (2.6) 

for any Ti, . . . £ £. 

2. Let Ai, . . . , Ak, Ak + i be k + 1 distinct sets in A, then 

li Al ...A k {Tx x • • • x r fc ) = fi Al ...A k A k+1 (TxX---xT k xE) (2.7) 
for any Fx, . . . ,T k £ £ . 
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For any Ax, . . . , distinct sets in A, we consider A' = {A' Q — 0', A! x , . . . , A' m } the smallest 
semilattice generated by {0', Ai, . . . ,Ak}- Let Cx, . . . ,C m £ C be the left-neighbourhoods on 
A': Ci = A't \ (U}"o^.)- We define the probability measure HA 1 ...A k on (E k 1 £® k ) as following, 

H Al ...A k (Ti X ••• X r fc) 

= / v(dxo) Pci (xo; dx A > ) Pch 5 & x a> )•■• Pc m ; dx A , )lri (^Ai ) ■ • ■ 3-r* (a: a J- 

where rj,...,^ <E £. We note that for each variable x Ai , i G {l,...,fc}, there exists a 
corresponding one x^'. , ji e {1, . . . , m}. We also remark that the formula does not depend 

on the consistent numbering used for A', since neither d nor xc 4 , i G {1, . . . , m} are changed 
with a different ordering. These two remarks ensure that the previous definition is consistent. 

Consider now the first consistency condition that must satisfy fi Al ... Ah . Let Ax,... ,Ak be 
k distinct sets in A, ri,...,Ffe be in £ and 7r be a permutation on {1, Then, we 

know that families {Ai, . . . , A^} and {A v m, . . . , A v ^)} generate the same semilattice A' = 
{A' Q = 0',^4' 1 , . . . ,A' m }. And, since the definition of ^A 1 ...A k given above does not depend on 
the ordering of the semilattice A', we obtain equation (2.6) 

To verify the second consistency condition, let Ax, ■ ■ ■ , Ak+i be k + 1 distinct sets in A and 
r 1; ...,r fc be inf. Let A 1 = {Aj = 0', A\, . . . , AiJ and A 2 = {A$ = 0', A\, . . . , A*,} be the 
two semilattices respectively generated by {Ai, . . . , Ak} and {Ax, . . . , Ak, Ak+x}- We clearly 
have A 1 C A 2 . Let / : E Ul M> R + be the following positive measurable function, 

V{x A i,...,x A ^) G E ni \ f{x A i,...,x A ^) = l ri (x Al )---lr k (x Ak ). 

The definition of / is consistent since {Ax, . . . , Ak} C A . Furthermore, if we apply Lemma 2.5 
to A 1 and A 2 , we obtain 

Pc ii i da; ^^ ) lr i ) ' ' ' x r fc Oa* ) 

PC ' 2 ( X ^ 2 ' ) ) " ' ^ ) lR ( :E ^ + l )' 

which exactly corresponds to the second consistency equation (2.7). 

Therefore, using Kolmogorov's extension theorem (see e.g. Appendix A in [26]), there exists 
a probability measure P„ on (fi, J 7 ) such that for any Ai, . . . , Ak in A and Ti, . . . ,Tk in £, we 
obtain 

P„(A Al GTi,...,^ er fc ) = ^A 1 ...A fc (Ti x •■■ xr fe ), 

where A is the canonical process. A usual monotone class argument ensures the uniqueness of 
this probability measure. 

We have to verify that under P^, A is a C-Markov process with respect to (J- A ) A £A, an d 
with initial measure v and C-transition system V . The first point is clear, since for any To G £, 
Pv(A„, G r ) = u{T ). 

Consider now C — A \ B in C, where B = U k =1 Ai. Let A[, . . . ,A' m be in A such that 
A ■ n C = for each i e {1, . . . , m}. Without any loss of generality, we can suppose that A' = 
{A' = 0', A'i, . . . , A' m , A} is a semilattice with consistent numbering and such that {Ai}i<k Q 



/ z/(dx )P c i(x c i;da: A i)--- 
/ v(dx )P C 2(x c 2;dx A 2)--- 

JP2 + 1 ° 
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A'. Let Cx,...,C m € C be the left-neighbourhoods C 4 = A' t \ (ifjZ^A'A. We remark that 
C = A \ (WJ^qA^) and X A i is C/^-measurable for each i G {1, ...,m}. Therefore, for any 
r, Ti, . . . , r m G £, we have 

E„ [ l Fl (X Al )■■■ l r „ (X A , m ) P„ (X A G T | £* ) ] 

= p„(x a; g r 1; . . . , x A , m g r m , x A g r) 

= / v(&xq)\ / P Cl (xo;dx A > ) ■ ■ ■ Pc m (xc m ;dxA> m ) Pc{*c]dxA) 
Je Lj_e">+i 

lriC^A'J • • • lr m (xA> m ) lr(au) j 

We can isolate the integral over xa, i-e. J E Pc( x c; da; a) 1t(x a ) = Pc( x c; T), and obtain 
E„ [ l Fl (X A; ) • • • lr m (x Am ) P„ (X A g r 1 55) ] 

= / u(dx )Pc 1 (xo;dx A ') • ■ ■ Pc m (*c m ;dx A > ) lrA x A')' ' ' ir^A' )Pc(xc; T) 

= E„ [ l Tl (X A{ ) • • • lr m (X^ ) P c (Xc; r) ] . 

Therefore, using a monotone class argument, we obtain the C-Markov property with respect 
to the natural filtration {Ta)a^Ai i- c - ^v{X A G T\Qq) = Pc{Xc;F) P„-almost surely for all 
C G C and T G £. □ 

Usual notations P^ ( . ) and E x [ . ] arc used in the sequel in the particular case of Dirac initial 
distributions v = d x , x G E. Similarly to the classic Markov theory, if Z is a bounded random 
variable on the probability space (f2,.F, P), a monotone class argument shows that the map 
x i y E X [Z] is measurable and for any probability measure v on (E,£), we have 

E V [Z] = / v(dx)E x [Z}. 
Je 

2.2. Set-indexed Markov properties 

In this section, we compare the C-Markov property to the set-indexed Markov literature. Let 
first recall the definitions of Markov and sharp Markov properties which have been introduced 
in [25]. 

Definition 2.6 (Markov SI processes [25]). A set-indexed process X is said to be Markov if 
for all B G A(u) and A\, . . . , Ak G A such that A4 ^ B, i G {1, . . . , k}, and for any measurable 
function f : R fe — > R+, 



a.s. 



E[f(X Al ,...,X Ak )\F B ] = E[f(X Al , . . . ,X Ak ) | Tqb n •7 7 uJ =1 aJ 

where the sigma field Tqb corresponds to Tqb = o~({Xa] A £ A, A C_ B, A ^. P }) . 

Definition 2.7 (sharp Markov processes [25]). A set-indexed process X is sharp Markov 
if for all B G A(u), 

Tb -L J^B" I Pas, (2.8) 
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where for any sigma-fields Ti,^, T?,, the notation T\ _L Ti \ J- 3 means that J-\ and J- 2 are 
conditionally independent given T%, and the sigma field Tb" is defined by J-b c = o~({X A ; A € 
A,A£B}). 

As recall in the introduction, another Markov property, called set-Markov, has been described 
in [5] and deeply studied in both [5] and [4]. 

Definition 2.8 (set-Markov processes [5]). A set-indexed process X is set- Markov if for 
all B, B' G A(u), B C B' and f : R — > R+ measurable function, 

E[f(AX B >) I Fb] = E[f(AX B ,) I AX B ] P-a.s. 

Different relationships between these Markov properties have been proved, respectively, in 
[25] and [5]: 

set-Markov =>■ sharp Markov and Markov =>• sharp Markov, 

where the last implication is an equivalence when the filtration satisfies an assumption of 
conditional orthogonality (see Definition 2.3 in [25] for more details). 

We prove in the following proposition that the C-Markov property implies both Markov and 
sharp Markov properties. 

Proposition 2.9. Let (Q, T , (T A ) A ^ A , P) be a complete probability space and X be a C-Markov 
process with respect to {J~a)aeA- Then, X is also Markov and Sharp Markov. 

Proof. Let X be C-Markov on (CI, T , (T A ) A ^ A , P)- Since the Markov property implies Sharp 
Markov, we only have to prove that X is Markov. 

Let B = U l l=1 Aj G A{u) and A x , ■ ■ . , A k G A such that A t B for each i E {1, . . . , k}. The 
collection of sets {A\, . . . , A^,A\, . . . , Aj} generates a semilatticc A' — {A' = 0', A! x , . . . , A' m }. 
Without any loss of generality, we can suppose that the consistent numbering of A' is such that 
there exists p < m which satisfies, 



Vie {!,..., m}; A'£B 



i > p. 



We also introduce the usual lcft-ncig hbourhoods d, . . . , C m G C, C; = Al i \ U*C^.. We note 
that for all i G {p, . . . , m}, since C, n B = 0, Tb Q G*c ■ Then, if / is a measurable function 
/ : R fc — > R + , we have 



E[f(X Al ,. ..,X Ak )\T B ] = E[E[f(X Al ,. ..,X Ak )\G*J\F B ] 



= E 



R 



Pc m (X Cm ; dx A > ) f(X Al X Ak _ 1 , x A > m ) 



where we assume that A' m = A^. Therefore, by induction, we obtain 
E[f{X Al ,...,X Ak )\F B ] 

Pc p (X Cp ; dx A > v )■■■ P Cm (X Cm ; dx A > m ) f(x Al ,...,x Ak ) 

, x Ak ), 



E 



Rm-p+1 

Pc p (X Cp ; dx A . )■■■ P Cm (X Cm ; &x A , m ) f{x Al , 



Rm-p + 1 



(2.9) 
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since for alH G {1, . . . ,p — 1}, X^/ is .Fa-measurable (A^ C £?,). 

We also observe that for each i G {p, . . . , m}, A i C \J k - =l Aj, and therefore, is J- U k Aj - 

measurable. Furthermore, let U G Ac t such that ?7 7^ A' p , . . . ,A' m . Then, according to the 
definition of p, U C i?. But, since Cj n B = 0, we also have U ^ B° , and therefore JQ/ is 
Tq b -measurable . 

In equation (2.9), since we integrate over the variables x A > , ■ ■ ■ , x A' m , the only random 
variables X\j which are left are such that U G Ac^ and U ^ A' p , . . . , A' m . Therefore, the 
integral (2.9) is J-yfc - and J-"aB-measurable, and we obtain the expected equality, 

nf(x Al , . . . , X Ak ) \Fb] = E[f(X A „ . . .,x Ak ) I F dB n .F uf=iA J. 

□ 

Although both set-Markov and C-Markov properties imply sharp Markov, these are nev- 
ertheless different Markov properties. Indeed, let simply consider the empirical process X A = 
ST=i l{ZjG^}j where (Zi)i<, n are i.i.d. random variables. It is shown in [5] that X is set-Markov, 
but it can be checked that X is not C-Markov (and in fact also not Markov). Conversely, the 
set-indexed SaS Ornstein-Uhlenbeck process introduced later is a C-Markov process which is 
not set-Markov (see Section 2.5). 

C-Markov and set-Markov properties can be seen as two consistent ways to introduce a set- 
indexed Markov property which leads to the definition of a transition system V and Q, which 
characterizes entirely the finite-dimensional distributions. If both V and Q satisfy a Chapman- 
Kolmogorov like equation, 

Pcf = Pc'Pc".f and QBB"f = Qbb' Qb'b" f> (2.10) 

an important difference lies in the indexing used. On one side, V = {Pc( x c; dx A ); C G C} 
consider variables indexed by A, whereas Q = {Qbb'{xb',<^xb>)', B, B' G A(u),B C B'} used 
A{u) as indexing collection. 

In fact, as stated in [5], the Q-Markov property concerns the global extension of the process 
AX on A(u). This explains why a supplementary assumption is needed on the transition system 
to ensure the existence of AX. Indeed, Theorem 1 in [5] requires that the following quantity, 

^ m 

/ li(dxo)lr {xo)T\lri(xi-Xi-i)Q u i-i A . u i A Xx i - 1 ;dx l ), (2-11) 

must be independent of the ordering of the semilattice A' = {A , . . . , A m } in order to be able 
to construct the corresponding Q-Markov process. We note that this last assumption is not 
necessary when Q is homogeneous, as proved in [20]. 

On the other hand, the C-Markov property is independent of the existence of an additive 
extension on A(u). The indexing collection A is supposed to satisfy the Shape assumption to 
simplify notations and the set-indexed formalism, but it can be verified that the example of 
the set-indexed Ornstein-Uhlenbeck process considered in Section 2.5 exists on any indexing 
collection, and does not have an additive extension when the Shape assumption does not hold 
on A. 
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2.3. Properties of C-Markov processes 

In section, we investigate properties such as projections on flows, conditional independence and 
homogeneity of transition probabilities, related to C-Markov processes. Let first recall that an 
elementary flow is a continuous increasing function / : [a, b] C R+ — > A, i.e. such that 

(i) Increasing: Vs, t G [a, b] ; s < t => /(s) C /(f); 

f£i) Outer-continuous: Vs G [a, 6) ; f(s) = p| 1J>s /(v); 

(mj Inner-continuous: Vs € (a, 6) ; /(s) = Uu<s 

We prove in the next proposition that elementary projections of C-Markov processes are real- 
parameter Markov processes. 

Proposition 2.10. Let (£l,J-, {J~a)aeA^) be a complete probability space and X a C-Markov 
process with respect to {J-a)aeA- 

Then, for any elementary flow f : [a, b] — > A, the projection X^ of X along f is a Markov 
process with respect to the filtration = (-^/(s)) sG r a y- Furthermore, X* has the following 
transition probabilities, 

Vs < t G [a, b] ; P[ t (x s ;dx t ) = P f{t) \ f{s) (x f{s) ;dx f{t) ), 

where V is the C-transition system of X . 

Proof. We simply verify that the Markov property stands with the expected transition proba- 
bilities. Let / be an elementary flow and s < t be in [a, b\. We note that Ff( s ) Q @f(t)\f(s) an< ^ 
A-f(t)\f(s) = {/( s )}- Therefore, for all r <G £ , we have 

P(JT/ G L | Ff)=P(P(X m £T\g* fmf(s) ) | T m ) 

= nPf(t)\m(x f{s)] r) 1 7> (s) ] = Pl t (x£-,r). 

□ 

We note that the converse result is not true: it is not sufficient to have elementary projections 
which are Markov to obtain a C-Markov process. Furthermore, Proposition 2.10 can not be 
extended to simple flows, i.e. continuous increasing function / : [a, b] — > A(u), since this property 
characterizes entirely set-Markov processes (Proposition 2 in [5]). 

We now prove that the C-Markov property implies a commutation property on the filtration. 
This classic condition is usually called (F4), or commuting property in the multiparameter 
literature, and has been first introduced by Cairoli and Walsh [9] for two-parameter processes 
and extended to the set-indexed formalism in [24]. We assume in the following Theorem that 
the filtration (Fa)aeA is included in the er-field := o-({Xa] A G A}). 

Theorem 2.3 (Conditional independence). Let (f2, T , (J 7 a)aeA, P) be a complete probabil- 
ity space and X a C-Markov with respect to {Ta)aeA- 

Then, the filtration (J-a)aeA satisfies the conditional independence property (CI), i.e. for 
all U,V G A and for any bounded random variable Y on the space (fl, J-^P), we have 

E[E[Y\Tu] \Tv] =E[E[Y|JV] \Tv] =E[Y\T Un v} P-a.s. 
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Proof. Let U, V € A. If U C V or V C {/, the equality is straight-forward. Therefore, we assume 
U <£V and V ^U. Using a monotone class argument, we only have to prove that 

E[E[fx{X M )---f k {X Ah )\T u ] \T V ] =nfi(X Al )---fk(A k )\F U nv], 

for all k € N, Ax, . . . , A k G A and fx, ■ ■ ■ , f k '■ E —> R+ measurable functions. Without any 
loss of generality, we assume that A' = {Ao = 0', Ax, . . . , A k } is a scmilattice with a consistent 
numbering which contains the sets U, V and U fl V. We denote as usually (Ci)i<k the left- 
neighbourhoods in A', i.e. Cj = A; \ (U'CqA,). Finally, we also assume the ordering of A 1 is 
such that there exist fc[/ny? ky € N which satisfy fcc/ny < ^v, 



Vi e {1, . . . , kunvh AiCA kunV :=Ur\V and Vi e {1, . . 
Then, we obtain 

E[E[fx(X Al )---f k (X Ak )\F v ] | Fu] 
= E[E[E[fx(X Al ) ■ ■ ■ f k (X Ak ) | g* Ck ] | F V ] | J"u] 



,fcy}; Aj C A fev := V. 



E 



E 



p c fc (X Cfc ; dx Ak )/i ) ■ • • / fe 



since J-"y C . Therefore, by induction, we get 
E[E[fx{X Al )---f k {X Ak )\F v ] \Fu] 



E 



E 



Pc ky+1 (X Cfcv+1 ; dx Akv+1 ) ■■■P Ck (X Cfc ; dx Ak ) 
fi{X Al ) ■ ■ ■ f kv (X Akv ) f kv+ x(x Akv+1 ) ■ ■ ■ fk(x Ak ) 



Every random variable X Ai which is left in the previous integral is such that A, C V, and thus 
J-y-measurable. Furthermore, for each i G {k{j n v + 1, . . . , ky}, we have 



U n Q c u n (A \ c/ n v) = (U n A) \ (U n V) = since A c v. 
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Therefore, T\j C Q* c . and still by the induction, we obtain 

E[E[/ 1 (jr Al ).../ fc (x^ b )|JV] I ^] 

Pc fc „+i(X Cfcv +1 ;dx A 



-Pc fc (X Cfc ;dxA fc ; 



fl(X Al ) ■ ■ ■ f kv +l(xA kv+1 ) ■ ■ ■ fk(x Ak ) 



Tn 



E k ~ k unv 



Pc kunv+1 (X Cfc[/rw+1 ; dx Akunv+1 ) ■■■P Ck (X Cfc ; dx Ak ] 



E k ~ k unv 



fl(X Al ) ■ ■ ■ fk unv (XA kunv )fk unv + l{xA kunv + 1 ) ■ ■ ■ fk(xA k ) 

Pc krjnV+1 (X CklJnv+1 ;dx AknnV+1 ) ■ ■ ■ P Ck (X Ck ;dxA k ) 



TTj 



fl(X Al ) ■ ■ ■ fk un v( X A kunv )fk un v + l( x A kunv + 1 ) ■ ■ ■ fk(xA k ) 

= E[f 1 (X Al )---fk(A k )\T U nvl 

since random variables Xj^ t which are left in the integral are J-j/nv-rneasurable (j4j C U D V 
for alH G {1, . . . , k unv }). □ 

In the next theorem, we investigate the extension of the simple Markov property to the C- 
Markov formalism. In order to introduce the concept of homogeneous C -transition system, we 
assume that there exists a collection of shift operators (9jj)u£A on A which satisfies: 

(i) for any U £ A such that U° ^ 0, we have A C {Qu{A))° for all A £ A; 
(ii) for any A G A, U i-> Ojj(A) is an increasing monotone outer-continuous function with 
Q<b'{A) = A; 

(Hi) for any U £ A, 9u is stable under intersections and 0j/(0') = U. 

For any U £ A, the operator Bjj is extended on A(u) and C by 

9 u (B) = U% =1 e u (A i ) and 9u(C) = 6 V {A) \ 6u{B), 

for all B = U^ =1 A Z G A(u) and C = A \ B G C. 

To illustrate this notion, let simply consider the multiparameter setting {[0,i];i £ R-+}- 
Then, the natural family (9 u )ueT of shift operators corresponds to the usual translation on 
R+, i.e. 

V«,ieRf; 9 u (t) = 9 [0 , u] ([0,i\) :=[0,t + u]. 

We can easily check that (fl tt ) u gR« satisfy the previous conditions. 

Let now introduce the notion of homogeneous C -transition system. 

Definition 2.11 (Homogeneous C-transition system). A C -transition system V is said to 
be homogeneous with respect to (Ou)ueA if H satisfies 

W G A,C = A\B G C; P c (x c ;dx A ) = Pg u{C ){^e u (cyAxe u (A))- 

A C-Markov process is said to be homogeneous w.r.t (Ojj)ueA if its C-transition system is itself 
homogeneous. 
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We can now establish a simple C -Markov property. We consider in the following theorem the 
canonical space il = E A and the canonical process X. 

Theorem 2.4 (Simple C-Markov property). LetV be an homogeneous C -transition system 
w.r.t (Ou)ueA- Then, the C-Markov process X satisfies 

E v [f(Xo6u) | Fu] = E Xu [f(X)] P„-a.«., 

for all U £ A, f : E A — > R + measurable function and v initial measure. 

Proof. Let A\, . . . , be in A. Without any loss of generality, we can suppose that A' = {Aq = 
0', Ax, . . . , Ak} is a semilattice with consistent numbering. As usually, Ci, . . . ,Ck £ C denote 
the left-neighbourhoods Ci = Ai \ (U'CqA,) where i £ {1, . . . , fc}. Then, for any measurable 
function h : E k — >• R + and for all U £ A, we have 



E v [h(X 9u ( Al) , . . . ,Xg u{Ak) ) \Fu) 



E v [E v [h{X eu(Al) ,. 



■i X e u (A k ))\Ge u (c k ) 



R 



p e u {c k ){^eu{c k yAxe u{Ak) ) h(X Bu ( Al)l . . . , X Bu{Ak _ l)l x Su {A k )) 



since for each i £ {1, . . . , k}, 9jj(Ci) U = 0, and therefore Tu C Q^/^y By induction, we 
obtain 

E„[h(X 8u ( Al ), . . ,,Xe u (A k )) I Fu] 

P 6u (Ci ) ( X U 5 dx 9u ( Al ) ) . . . P 9u ( Ck )( x 9u (C fc ) ! dx 6[/ (j4fc ) ) K x e v , • • • , X 6u ) 



R< 



R<- 



P Cl (Ac/; da^ ) • • • Pc k (xc fc ; dxA fc ) h(x Al ,...,x Ak ) 



= E Xu [h(X Al ,...,X Ak )}, 

since P is homogeneous and 9u(C\) = 9u(A\)\0u($') = 6u{Ai)\U. A monotone class argument 
induces the expected result. □ 



2.4. C -Feller processes 

In this section is investigated the extension of classic results on Feller processes to the C-Markov 
formalism. In this purpose, we first need to recall the assumption of separability from above on 
the indexing collection A. 

Definition 2.12 (Separability from above). There exist an increasing sequence of finite 
subclasses A„ = } of A closed under intersections and such that B n £ An; a 

sequence (e n )neN decreasing to and a sequence of functions g„ : .4 — > A n U {T} such that 

(i) for any A £ A, A = n n g n (A); 

(ii) g n preserves arbitrary intersections and finite unions; 
(Hi) 'for any A £ A, A C (g n (A))° ; 
(iv) g„(A) C g m (A) ifn> m; 
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(v) for any A G A, dn(A, g n (A)) < e n for all n G N such that g n (A) C £>„, 

where dn denotes the Hausdorff distance. 

We remark that the previous definition is slightly stronger than the usual one presented in 
[24] since each g n is supposed to be .4„-valued, and not A n (u). For any filtration (Fa)a€A, the 
family (g n ) n gN allows to define an augmented filtration (Fa)agA given by 

WAeA; Fa ■= f) F CJn(A) . 

riGN 

(Fb)b^a(u) and {Gc)cec given by equation (1.2) respectively denote the extensions of this 
filtration on A(u) and C. 

In the classic theory of Markov processes, a Feller semigroup P must satisfy the condition 
Ptf -^t^o f ■ Therefore, to adapt such a formula to the C-Markov formalism, we must define 
a pseudo-norm || • ||c on the class of increments C. For this purpose, let introduce a few more 
notations related to C. For any C = 4\B £ C, we assume that the numbering B = U* =1 Ai 
is such that dn(A, A\) < ... < d H (A, A k ). Then, we define a map tpc ■ {Uq, U c , . . . , Uq} — > 
{Uq, . . . , Uq} constructed as following (we recall that the definition of (U c )i< p is given in the 
introduction): 

1. iJjc{Uq) = Ai, where by convention Uq = A; 

2. ^Pc{Uq) = A\, where it is assumed that Uq = Ai; 

3. let i G {2, . . . ,p} and V = A\ fl U c . According to equation (2.1), we observe that Xa 1 = 
Y^H=i(~^) £i Ainu i i which implies the existence of j > i such that V = A\ n U c , Conse- 
quently, we set 

tPc(U c ) = U c and iPc(U£) = U c . (2.12) 
By induction, we obtain a complete definition of ipc- 
We observe that the construction of ipc implies that AX satisfies 



AXc = (Xa - X^ c (a)) 



V 

^(-l) £l (X V i - X^ c{U iyj 
i=l 



(2.13) 



The map ipc allows us to define the pseudo-norms \\C\\c and ||xc||c: 



l|C||c := max d H (U&,ipc(U c )) and ||x c ||e := max d E {x V i,x^ a rm))- (2.14) 

Finally, for any m G N, let C m denotes the sub-class {C G C ; \Ac\ < m and C C B m }. 
We can now introduce the definition of Feller C-transition systems and C-Feller processes. 

Definition 2.13 (C-Feller transition system). A C-transition system V is said to be Feller 
if it satisfies the following conditions: 

1. for any f G Cq(E) and for all C G C, 

PcfeC (E^), 

where for any k G N, Co(E k ) denotes the usual space of continuous functions that vanish 
at infinity; 
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2. for any f G Cq(E) and for all m G N, 

lim sup sup \P c f(xc) -P C "f(xc")\ =0. (2.15) 

p— W c = C'uC" EC™ x c" X C' 

\\C'\\c<p \\x c >\\c<P 

where, similarly to Definition 2.1, the sets C , C and C" are such that C — C fl A' and 
C" = C\ A', with A' G A. 

A C- Markov process X is said to be C-Fcller if its C -transition system V is Feller. 

The definition of a C-Feller transition system, and especially equation (2.15), may seem a bit 
cumbersome, but in the onc-dimcnsional case and if V is homogeneous, it corresponds to the 
classic Feller property ]im t ->o sup s > ||P s+t / - P s f\\oo = 0. 

Moreover, in the case of simple increments C — U\ V and C" = 0, we obtain a more classic 
formula 

lim sup ||P [ /\y/-/|| oo = (2.16) 

P~ ™ U.VeA, UCVCBjn 

d H (U,Ur\V)<p 

since \\U\ V\\c = d H (U, U D V) and Hx^-y^llc = d E (x v , x unv ). 

Equation (2.15) is also more complex than in the classic theory because in the context of 
set-indexed and multiparameter processes, we prefer the homogeneous hypothesis to be distinct 
from the C-Feller property. This decision is motivated by the existence of interesting C-Markov 
processes which are Feller but not homogeneous (e.g. the multiparameter Brownian sheet). 

In the following results, we assume that the C-Markov process X have outer-continuous 
sample paths, meaning that: 

VA G A, V£ > 0, 3a > 0; A C U G A and d H (A, U) < a d E (X A , X v ) < e. (2.17) 

We can now generalize a classic result from the theory of Markov processes. 

Theorem 2.5 (C-Markov w.r.t the augmented filtration). Let (0, T, (J : a)agA: P) be a 
complete probability space and X be a C -Feller process with respect to (J 7 a)agA which has outer- 
continuous sample paths. Then, X is C-Markov process with respect to the augmented filtration 
(!Fa)a£A, i- e - X satisfies 

K[f{X A )\G*c]=nf{X A )\K c ] P-a.s. 
for all C = A \ B G C and f : E h- > R + measurable. 

Proof. Let C = A \ B be in C, with B = Uj =1 Aj. We assume that the numbering of Ac = 
{U c , . . . , U^} is consistent. Let po > be maxi<i <: ,<p dn(U c , U c ). Then, for all n G N and for 
each i G {1, . . . ,p+ 1}, let C™ and D™ denote the following increments, 

C? =A\(BU\J g n (U c )) and D? = g n (U£) \ (b U Q g n (U c )) , 
V j=i / V j=i / 

where by convention g n (U§ +1 ) = A. For each i G {l,...,p}, let Df = g n {U c ) \ (Uj' =1 A)) be 
the extremal representation of D". As previously said, it is assumed that the numbering is such 
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that d.H(gn(Uc),A\) < ■ ■ ■ < d,H{gn(Uc), For each j, according to the definition of £)", 
there exist lj such that 

A) = g n (V*) n U% or A) = g n {U£) fl <;„([#) = g n {W c fl L#)- 

Since C P, there exists j < fcj such that C A* C g n {Uo). Therefore, as the family (g n ) n 
satisfies assumption (v), we have djj(g n (J7^), A 1 -) — > and A* converges to Uq. 

If we consider the particular case of A\, we obtain that du(g n (Uc), A\) — > and A| converges 
to an element V := U£ n [Z^ 1 £ .Ac. Let suppose ^ U£, implying that U£) > po. 

We know that d H (A\,V) -> 0, d H {g n {U^), A\) -> and d H (g n (U^),US) -> 0, which is in 
contradiction with the previous hypothesis. Therefore, f/g. n C^ 1 = f/^. 

Then, let V n 6 «4.£>™. According to the definition of D", must have the following general 
form 

V„ = U 3 J n fln (l# ) n g n (US) where jvJv S {1, . . . ,p}. 

Therefore, (Ki)neN is a decreasing sequence which converges to U^ v n f/ c V n Uq := ?7p V . Since 
converges to {/^, C\A\ is a decreasing sequence whose limit is also U c v . Hence, according 
to definition (2.12) of ipov-, we know that both V n and i^Dv-(Vn) converge to U£ v , and as the 
family (g n )n satisfies the assumption (v), for any p > 0, there exists N p such that 

Vn > N p ; d H (V n , {V n )) < p. 

Furthermore, since the sample paths of X arc outer-continuous, N p can be suppose large enough 
to satisfy 

Vn > N p ; d E (x Vn , X v £v ) < P and d E (x^ D „ {Vn) , X v k v ) < P 

Finally, as the two previous properties are satisfied uniformly for any V n £ «4.£>™ and i £ 
{1, . . . , p}, we obtain that for all n > A p , 

||D"|| c <p and ||X D T>|| c <p. (2.18) 

Let e > and / £ Cq(E). According to Definition 2.13, there exists p > such that 

sup sup \P c f(x c ) -Pc"f(*c")\ < e - 

c=c'uc"ec m x c" ,3c c' 
||C'|tc<P l|x c /|| c <p 

We observe that for each i £ {1, . . . ,p}, C? +1 = C? \ g n {U£) and Df = Cf n S„(E£), and there 
exists m £ N such that C™ and £)" belong to C m . 

Therefore, according to the Feller property and inequalities (2.18), we obtain 

Vi £ {1, . . . ,p}; |P C n/(X c n) - P cr+1 /(X cr+i )| < e. 

Thereby, by induction and since C" = C, we have |Pc/(Xc) — Pc" l +1 /(Xc™ +1 ) | < pe, for all 
n > A^p, which proves that Pc n /(X c ~ ) > PcfCX-c) almost surely. 

As we notice that for all n £ N, C C?™ > we can eventually prove the C-Markov property 

p+i 

with respect to the augmented filtration: 

E[f(X A )\g^}=E[E[f(X A )\g^ +i } | %\ =E[p c » +1 /(x c?+i ) I 
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And, using the dominated convergence theorem, 

E[f(X A )\§* c ] = lim E[P C n +1 /(x c - . ) | g*] =np c f(x c )\g*]=p c f(Xc). 

since X<7 is C/p-mcasurable. □ 

Before establishing a strong C -Markov property, we recall the definition of a simple stopping 
set, as introduced in [24]. A simple stopping set is an application £ : £1 — > A such that for any 
A G A, {uj : A C £(w)} G Ja- If the assumption Shape holds on the collection A, we can define 
the cr-algebra of the events prior to £: 

ft = {F G T : F n {£ C B} G F B > VBe -4(u)}. 

According to [24], if X has outer-continuous sample paths, is J^-mcasurable. 

Theorem 2.6 (Strong C-Markov property). Let (fl, F, (F A ) A&A , P) & e a complete proba- 
bility space and X be a C-Feller process with respect to (Fa)a€A with outer- continuous sample 
paths. Let also £ be a bounded simple stopping set, i.e. such that £ C V almost surely, with a 
given V € A. 

Then, if the C-Feller transition system V of X is homogeneous w.r.t (9u)ugAj X satisfies 
E v [f(Xo6 e ) | Tjt] = E X( [f(X)] V u -a.s. 
for any initial measure v and f : E A R + measurable application. 

Proof. Let F be in F^, A' = {A a = 0', A\, . . . , A k } be a finite semilattice of A, C\, . . . , Ck G C 
be the left-neighbourhoods C, = Ai \ (WrJ^Aj), with i G {1, . . . , k}. 

According to Lemma 1.5.4 [24], for any n G N, g n {£,) is a discrete simple stopping set which 
satisfies £ = n„<7 n (£) and as £ C g n (£), -Ff C F gn rn. Therefore, F G F g u) and we obtain for 
any ft G C (E), 

E v [l F h{Xe t{Ah) )] = mn E v [l F h{X egnm(Ak) )l 

since X and U ^ 9u are outer-continuous. Furthermore, as (?n(£) is a discrete stopping set and 
F n = U} G 7b C ^ (Cfc) , we have 

E V [1 F h(X 0dAk) )\ = lirn^ ^ E I/ [l Fn{ffn(?)=[/} ft(X eu(Afe) )] 

°°[/e.A„ 

Then, using the C-Markov property and the homogeneity of V, 

E„[1 F h(X edAk) )] = lirn^ ^ E„[l Fn{fln(€)=t/} P 6 i t , (0k) ft(X eu ( Cj ,))] 

= „ 1 ™ £ E ^[ 1 ^n{ s „(€)=a}^/i(X 0u( c (! ))] 
ue-4 n 

= lim E„[1 F P C »MX« 8 „«, «?„))]• 
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Finally, since Pc k h G Co(E^ c ^) and X is outer-continuous, the dominated convergence 
theorem leads to the equality 

E„[1 F h{Xg dAk) )] = E V [1 F P Ck h(Xe i{ c k ))}- 

By induction, we extend the reasoning to any collection hi, . . . ,hk in Cq(E), and obtain 

E v [1f hi(X g ^ Al )) ■ ■ ■ h k (Xg ( ^ Ak - ) )] 

= Eu[l F hi(Xg ( ( Al) ) ■ ■ ■ h k _i{X g ^ Ak _ l) ) Pc k h k (X e ^ Ch) )} 



P Cl (X € ; dx Al )...Pc k (x Cfc ; dx Ak ) hi (x Al ) . . . h k (x A J 



since %(0') = £• This formula corresponds to the expected equality 

E v [l F hi (X g {Al) )---h k (X 6( {Ak} )] =E u [l F E Xi [h 1 (X Al )--- h k (X Ak )]]. 



□ 



In Theorems 2.5 and 2.6 are considered C-Markov processes with outer-continuous sample 
paths. The question of the regularity of set-indexed processes is known to be non-trivial and 
more complex than in the multiparameter setting. Indeed, as exhibited in [1], there exist 
indexing collections on which the set-indexed Brownian motion is not continuous (and even 
not bounded). Different approaches have been investigated in the literature, using the metric 
entropy theory [1, 2] or more recently, the set-indexed formalism [21], to study this question. 
In this paper is only examined the multiparameter case in Section 3. 



2.5. Applications and examples 

To conclude this general study of the C-Markov property, we present several examples of C- 
Markov processes which are natural extensions of classic real-parameter processes. 

Example 2.1 (Processes with independent increments). A set-indexed process X has in- 
dependent increments if for all disjoints sets Ci, . . . ,C k G C, AX^ , ■ ■ ■ , AXc k are independent. 
Or equivalcntly, for any C G C, AXc is independent of Qq . 

Let Px c De the law of the increment AXc- Then, for all C — A \ B G C and r G £, we have 

v(x A g t\Qq) = ¥(Ax c g r — ax b i g* c ) 

= P Xc ( T - AX B ) := P C (X C ; T) according to equation (2.1). 

Therefore, set-indexed process with independent increments satisfy the C-Markov property. As 
proved in [5] , these processes are also set-Markov. 

Example 2.2 (Set-indexed Levy processes). Set-indexed Levy processes have been defined 
and studied mainly by Adler and Feigin [2] , Bass and Pyke [7] in the particular case of subsets of 
R , and by Herbin and Merzbach [20] in the general set-indexed formalism. In this last article, 
a set-indexed Levy process A" on a measure space (T, m) is characterized by the following 
conditions: 
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1 ) X^i = almost surely; 

2) X has independent increments; 

3) X has m-stationary Co-increments, i.e. for all V £ A and for all increasing sequences (Ui)i< n 
and (Ai)i<„ in A such that m(Ui \ V) = m(Ai), we have 

(AX Ul \ v ,...,AX Un \ v ) 4 (AX Al ,...,AX An ); 

4) X is continuous in probability. 

According to [20] , for any set-indexed Levy process X, there exists an infinitely divisible measure 
/i on (E,£) such that for all C £ C, Px c = f-i" 1 ^ ■ Since X has independent increments, it is a 
C-Markov process with the following C-transition system V, 

VC = A\BeC, Vre£; P c (xc;r) = ix m{c \T- Ax B ). (2.19) 

Conversely, we show, using the C-Markov property, that a Levy process can be constructed 
from any infinitely divisible measure (i. Indeed, let prove V satisfies the three conditions from 
Definition 2.1. 

1) For any C 6 C, Pc(xc; dxA) is clearly a transition probability; 

2) As m(0) = 0, we have P (x; dy) = 6 x (dy); 

3) For any C = A \ B e C and A' G A, let C = C n A' and C" = C* \ A' in C. Then, we 
observe that 

M m(C) = M rn(C) ^ ^m(C") and ^ + ^ = Ax A , ufl + Alyj^Bj 

using m(C) = m(C') + m{C") and the inclusion-exclusion principle. These two equalities 
induces the Chapman- Kolmogorov equation (2.2). 

We observe that the construction procedure given in [20] is in fact completely equivalent to 
the proof of Theorem 2.2 (in fact more general in the case of Levy processes since the Shape 
assumption is not required on the collection A). 

We can easily verify that the C-transition system is homogeneous w.r.t (9u)ueA if an( i only 
if the measure m is compatible with the family operators, i.e. Vt/ £ A, VC £ C; m(C) = 
m(6u(C)). 

Furthermore, if the measure m and the Hausdorff metric du satisfy the following mild 
condition, 

Vto£N 3K m >0 VC£C m ; m{C) < K m \\C\\ c , (2.20) 

then the C-transition system V of a Levy process is Feller. Indeed, let / £ Cq(E). For all 
C = C'UC", we know that 

Pcf^c) = J E y m{C ''\dx A )^Jj{x A + x AI +Ax B )^ c '\dx AI )Y (2.21) 
Using the Feller property of one-dimensional Levy processes, we obtain 



lim sup sup 

e'ec y<£E 
m(C')<p 



f{x A ,+y)^ c 'X&x A ,)-f{y) 
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Furthermore, if |jx C '|| < p, equation (2.13) proves that |Axc| < rap. Hence, since Ax^/. 
Axe + Ax_b and / £ Cq(E), we get 



lim sup sup 

c>ec *c"*c> 
m (C')<p ||x c /||c<p 



f{x A + x A , + Ax B )fx m ^(dx AI ) -f(x A + Axb") 



= 0. 



Assumption (2.20), equation (2.21) and this last equality induce the Feller property. 



lim sup 

p->o c=c i uC tt eC m x c „,x c , 

\\C'\\c<P ||x ,|| c <p 



sup |P /(x c ) - Pc>>f(x-c" 



0. 



In the particular case of the set-indexed Brownian motion, we observe that according to equation 
2.19, V is characterized by the following transition densities 



VC = A\BeC; pc(*c;y) 



1 



(27rm(C)) 



d/2 



ll«-Ax B || 
g 2m(C) 



Finally, we note that Theorem 2.3 extends the Cairoli- Walsh Commutation Theorem (see e.g. 
in [41]) to the set- indexed formalism, showing that the Brownian motion history is a commuting 
filtration. 

Example 2.3 (Set-indexed a-stable Ornstein-Uhlenbeck). The Ornstcin-Uhlcnbcck (OU) 
process is a well-known stochastic process, which has the following integral representation (see 
e.g. [40]): 

rt 

e -A(*-u)M(du), (2.22) 



where A > and M is symmetric a-stable random measure (a £ (0,2]) with Lebesgue control 
measure. 

A set-indexed extension of this process can not be directly deduced from equation (2.22), 
Nevertheless, as X is also a Markov process, we can introduce a C-transition system which 
generalizes the OU Markov kernel. 

More precisely, on the space (E,£) = (R, B(R)), a set-indexed a-stable Ornstein-Uhlenbeck 
process is defined as the C-Markov process with initial distribution v and C-transition system 
V given by 



f(a c X + e- Xm(A) 



I .Ac I 



(2.23) 



where a £ (0,2], AT is a symmetric a-stable variable S a (l,0, 0), / : E — > R+ is a measurable 
function and oc corresponds to 



1 - e 



-aXm(A) 



I Ac | 



^(-l)-e« 



\m(U£) 



i=l 



(2.24) 



Let prove that V is a well-defined C-transition system. 
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1) For any C € C, Pc(^-c'i dx A ) is clearly a transition probability; 

2) P$(x;dy) = S x (dy) since ct = 0; 

3) for any C = A \ B G C and A' g .4, let C" = Cni' and C" = C \ A' in C. Let prove V 
satisfies 

Pc.f(xc) = Pc>Pc».f ~ I Pc'(xc';dx A ,)Pc»(xc";dx A )f(x A ). 

Je 2 

where / : E i-> R+ is a measurable function. Using equation (2.23), we observe that 

pl-*o»l 



P C »/(x c «)=E 



where the numbering of A. C " is supposed to satisfy Uq„ = A' . Then, if X is random variable 
S a (l, 0, 0) independent of X, we obtain 



P c ,P c „f = E 



Xrri e Am ^C») 



i=l J ^ 



-Ara(A\A') 



Let ft. : A — > R be the deterministic map h(A) = x A e XmtyA \ It has an additive extension 
Ah on A(u), which satisfies according to equation (2.1): 



Ah(B U A') = x c/'„ e Am ^c») and A/i(B n A') = ^ (-l) e * 

i=l i=l 

Furthermore, using the inclusion-exclusion principle, we observe that 



Ah{B U A') - h(A') + Ah(B n A') = Ah{B) = M) 6 ' x v h e Xm(u ^ 

i=l 

Therefore, we obtain 

P c >P C "f{*c) = E\f(a c »X + ac-e~ Xm{A ^ A ' ] X + e ~ Xm{A) Ah{B) 



Since X and X are two independent SaS variables, we know that ac"X + ac>e * m ( A \ A ) ^ 
S a (a, 0,0), where 

(7 = Oqi + tjQne y x '. 

Then, using equations (2.24) and (2.1), a similar reasoning proves that a = ac, and therefore 
implies the expected the Chapman-Kolmogorov equation Pel = Pc'Pc I '■ 
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Hence, we have proved that such a C-Markov process exists. One can easily verify that in the 
case of A = {[0,i] ;t £ R+}, the Markov kernel of the classic Ornstein-Uhlenbeck process is 
obtained. 

The specific Gaussian case a = 2 is studied in more details in [6] . V is then characterized by 
the following transition densities 



Pc(xc; y) 



1 



ct c \ / 2tt 



exp 



2a% 



-Am (A) 



EC- 1 )"* 



Xjji e 



Am(C£) 



Furthermore, if v is a Dirac distribution S x , X is Gaussian process such that for all U, V 6 A 



E X [X V } = xe~ Xm ^ and Cov x (X U} X v ) = ^ I 



e -Am(C/AV) _ e -\(m{U)+ra{V))\ 



Results obtained [6] argue that X is natural extension of the Ornstein-Uhlenbeck process and 
also gives a natural justification of the expression of V (equations (2.23) and (2.24)). 

Finally, similarly to set-indexed Levy processes, we observe that V is homogeneous when 
the measure m is compatible with the family of operators (Ou)ueA and Feller under the mild 
condition (2.20). 



3. Multiparameter C-Markov processes 

After the introduction of any set-indexed concept, it seems natural to examine it the particular 
case of the multiparameter setting. Consequently, in this section, T is set to and A to the 
indexing collection {[0, t];t £ R+}. As previously said, the family (0 u )ueT °f shift operators 
correspond to the natural translation: 9 u (t) = #[o jU ] ([0, t]) := [0, t + u]. 



3.1. Right- continuous modification of C- Feller processes 

We begin by extending a classic result of the theory of Markov processes: multiparameter 
C-Fcller processes have a right-continuous modification which C-Markov with respect to the 
augmented filtration. 

In the sequel, denotes the usual one-point compactification of E, i.e. the set E U {A} 
endowed with the following topology: A C Ea is open if cither A C E is open in the topology 
of E or there exists a compact K C E such that A = Ea \ K. 

Theorem 3.1 (Cad modification). Let (A t ) tgR w be a multiparameter process, (J r t)teR N a 
filtration and (¥ x ) x£ e a collection of probability measures such that for all x £ E, X is a 
C -Feller process on (Q, J-,P X ), with respect to (^ 7 t) te R,N, and¥ x (Xo = x) = 1. 

Then, there exists an E 'A-valued process (^t)teR. N which has right- continuous sample paths 
in Ea, and such that for any x £ E and all t £ R+ , X t = X t P x -a.s. Furthermore, X is a 
C- Feller process on (Q,,J-,¥ X ) with respect to the augmented filtration (^ r t) tg R,w. 



P. Balanca/ An increment type set-indexed Markov property 26 

Proof. Let W = {</)„; n S N} be a collection of functions in Cq(E) which separates points in 
£aj i-e., for any x,y G there exists ip G H such that <p(x) ^ <p(y)- For all r G and 
<p E H, let the process M r be given by 

VHre R^; M\ = P [0 , rm <p(X t ). 

For any x G E, M r is martingale with respect to the natural filtration (Jfjj^iv of X: 

Vt^t'^re Rf ; E X [M[, \ T?} = E x [P [0jr]V[0 ,^(X t ') 1 7?] 

= P{0.t>]\{0,t](P[0,r]\[0,t']<f)(X t ) 
= P\o,r]\[0,t]<P(X t ) = M[, 

using Chapman-Kohnogorov equation (2.2). 

According to Theorem 2.3, the filtration (J t ) f6 RN is commuting. Then, as stated in [26] 

(and originally proved in [3]), since M r is a bounded multiparameter martingale with respect 
to a commuting filtration, there exists an event A y . r G J- such that for all x G E, P X (A^ r ) = 
and for all to G A^,,, 

lim MJ(w) exists for alH -< r G R+ . (3.1) 

»4.t, s6Q™ 

The event A is defined by 

A = P| A^ r 

<peH,reQ% 

and satisfies for all x G E, P X (A C ) = 

Let prove hm s ^ 4 sg Qjv X s (uj) exists for all uj G A. We proceed by contradiction. Hence, let 

suppose there exist w G A, i G R+, e > and two decreasing sequences (s^neNjKlneN m 
such that lim„ e N s,\ = t, lim ng N s 2 = i and 

Jf^w) := lim X s i (u) ^ lim X s 2 (w) := AT 2 (w), 

where the limits stand in E&. 

Then, as functions in T-L separate points in Ea, there exists ip G % such that tp(X^(u;)) ^ 
ip(Xf(oj)). Let e > be e = — </j(AT t 2 (u;))| and (« n ) n6 N be the decreasing sequence 

Since the transition system P of X is Feller, equation (2.16) implies there exists a > such 
that 

Vm d « d 2t G R+; ||u-u||oo<o: =^ ||-^o,t>]\[o,-u]¥> - "Hloo < g- 

Furthermore, since ii„ — >■„ i, there exists k G N such that for all n > k, \\u n — t\\ < a, which 
implies that for any n> k, \\uk — s„|| < a and — s„|| < a. 
Therefore, for all n > k, we obtain 

ll p lo,« fc ]\[o,.i]v-HL ^ | and ll p [o,^]\to,4]^-^L ^ |- 

Since w G A v . Ufc and according to equation (3.1), fc can be chosen large enough such that for 
all n > k, we have \M^{oj) - M" 2 k (oj)\ < §, i.e. 



Vn > k; \P[o, Uk ]\[ Q y n ]<p(X s i (uj)) - P[ , Uk ]\[ , s i]<p(X s 2 (w))| 



< -. 
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Finally, as the function ip is continuous, k can be supposed to satisfy 

Vn > fc; \<p(Xl(u)) - V {X s i n {w))\ < | and \^(Xf(co)) - <p(X*Jw))\ < |. 
Using previous inequalities, we obtain for all n > k, 

\<p{Xl(u)) - <p(X?(uj))\ < \<p(X}(w)) - <p(X,i n (u))\ 

+ |V(^H) - P[0,u k ]\[0,siMX s i (U)))\ 

+ \ p [o,u k ]\[o,si]P(X s i n (uj)) - P[a,v k ]\[o,8l]<p(Xs*(u))\ 
+ \<p(X s %(u)) - P[o < u k }\[o < sl) < p(X s 2 n (uj))\ 
+ \<p{X*(u))-<p{X<>(u>))\ 
5 

which is in contradiction with the definition s. 

Therefore, for all w e A and t £ R+, lim s ^ s gQ« X s (uj) exists in and the process X can 
be defined by 

' lim s |t, s eq« X s (uj) ifweA 
xq if uj ^ A, 



Vi 6 R+; X t 



where xq is an arbitrary point in E. X is an S^-valued process which is right-continuous. 

Let now prove AT is a modification of X. Let ipi and ip2 be in Co(E). Then, for all x <G E 
and t € R+, we have 

E*[<pi(X t )(p2(X t )] = lim Ej^(X s )^ 2 (X t )] 

= lim E x [E x [^p 1 (X s )\T t ]i P2 (X t )] 

sit, sSQ£ 

= lim E4P [0iSmt] cp 1 (X t )ip 2 (X t )]=E4 i p 1 (X t )i P2 (Xt)}, 

sit, s6Q^ 

using the dominated convergence theorem and the Feller property. A classic monotone class 
argument extends this equality to any measurable function / : E 2 — > R + , and in particular, we 
obtain 

VxeE, VteR^; F x {X t = X t ) = 1. 

The process X is clearly adapted to the filtration (J ( ) feR » and using Theorem 2.5, we get the 
C-Markov property with respect to the augmented filtration. □ 

We notice that the martingale argument used in the proof can not be directly transpose 
to the set-indexed formalism since there does not exist any result on set-indexed martingales 
(see [24]) which states the existence of a right-continuous modification. 



P. Balanca/An increment type set-indexed Markov property 



28 



3.2. C-Markov and multiparameter Markov properties 

A vast literature exists on multiparameter Markov properties, especially in the particular case of 
two-parameter processes. It includes works [31, 34, 11, 12] previously mentioned on Paul Levy 
sharp-Markov and germ-Markov properties, but also literature on Gaussian Markov random 
fields [37, 29, 10] and strong Markov properties [15, 16, 27]. Different surveys and books [38, 
13, 14, 23] have been written on these distinct topics. In the context of this article, we focus on 
two existing multiparameter properties which can be directly linked up to our work. 

We begin with the *- Markov property which has been introduced in [8] in the context of 
two-parameter processes. A process (X s ,t)s,t is said to be *-Markov if for all s,iS R+, h, k > 
and r G £, A satisfies 

F(X s+h , t+k G r I Q* t ) = P(X s+ h,t+k G T | X s j,X s +h,t,X s j+k), (3.2) 

where Q* t correspond to the strong history previously introduced. The *-Markov property has 
been widely studied and used in the literature, leading to several interesting results, including 
martingale characterization in the Gaussian case [36] , equivalence of different definitions [28] , 
properties on transition probabilities [32] and sample paths cadlaguity [46]. We note that the 
^-Markov property also appears in the study of two-parameter Ornstein-Uhlenbeck processes 
[42, 45]. 

As stated in the following proposition, it turns out that C-Markov and *-Markov properties 
are equivalent in the two-parameter setting. 

Proposition 3.1. In the context of two-parameters processes, which corresponds to T = 
and the indexing collection A = {[0, t];t 6 the C-Markov and * -Markov properties are 

equivalent. 

Proof. Let A be a two-parameter C-Markov process. For any s, t G R+, h, k > and r G £ , we 
consider the increment C = A\B := [0, (s + h, t + k)] \ ([0, (s, t)} U [0, (s + h, t)} U [0, (s, t + k)]) . 
Then, we clearly observe that Xc = (X s j,X s+ h,t,X Syt+ k) and Q* t = Qq. Therefore, the C- 
Markov property V(X A G T \ Q£,) = F(X A G T \ X c ) induces equation (3.2). 

Conversely, let A be a *-Markov process and C — A\ B be an increment where A = [0, (s, t)] 
and B = U" =1 [0, (s,,tj)]. Without any loss of generality, we can suppose that si < s 2 < ■ ■ ■ < s n . 
Then, since we consider an extremal representation of B, it also satisfies t\ > t% > ... > t n . 
Therefore, we obtain 

Ac = {[0, (S!,h)] , [0, ( Sl ,t 2 )} , [0, (s 2 ,t 2 )} , . . . , [0, (s n _i, *„)] , [0, (S B , tn)]}- 

Then, it is consequence of Theorem 3.7 from [28] that A satisfies the C-Markov property on 
the increment C. □ 

Proposition 3.1 clearly shows that the C-Markov property offers an elegant way to extend the 
two-parameter *-Markov property to multiparameter processes, and more largely, to set-indexed 
processes. 

Furthermore, the set-indexed formalism allows to simplify notations and concepts compared 
to the *-Markov framework. Indeed, as stated in [32, 46], the concept of ^-transition function 
(P 1 , P 2 , P) has been introduced to characterize the law of *-Markov process. The corresponding 
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notion of C-transition system V replaces the triplet (P , P 2 , P), and reduces the different con- 
sistency hypotheses on (P 1 , P 2 , P) to the single Chapman-Kolmogorov equation (2.2). Finally, 
we also note that Theorem 3.1 extends the regularity result obtained in [46] for two-parameter 
processes. 

A second interesting Markov property is the multiparameter Markov property that is con- 
sidered in [26]. It has been widely studied in the literature (see e.g. [22, 33, 44]), in particular 
to obtain sample paths properties using the potential theory 

An valued process X = {X t ; t G R+ } is said to be a multiparameter Markov process if 
there exists a filtration (J r t)ten. N an d a family of operators T = {Tt; t G R+ } such that for all 
x G E, there exists a probability measure P^ which satisfies 

(i) X is adapted to (-Pt)teRj' 

(ii) 1 1 — y Xf is right-continuous P^-a.s. for all x G E; 

(Hi) for all t G R+, J~ t is P^-complete for all x G E; moreover, (J() jeR » is a commuting 
filtration with respect to all measures P x , x G E i.e. for all s, t G R+ and for any 
bounded J^-measurable random variable Y, 

E x [Y\F s }=E x [Y\F sXt ] P x -a.s. 

(«vj for all s, t G R+ , for all / G Cq(E) and for any x E E, 

E x [f(X t+s )\T s ] = 7 t f(X s ) P x -a.s. 

(ty for all x € E, P X (X = x) = 1. 

Furthermore, X is said to be a Feller process if 

(%) for all t G R£, T t : C* (P) -> C* (P); 
(m) for any / G C (.E), lim t ^ ||T t / - /||oo = 0. 

In the following proposition, we observe that homogeneous C-Fcllcr processes are also multi- 
parameter Markov processes. 

Proposition 3.2. LetV be an homogeneous and Feller C -transition system, (W x )xeE a family 
of probabilities and X = {X t ; t G R+} the multiparameter C-Markov process constructed in 
Theorem 3.1, which is right- continuous ¥ x -a.s and satisfies ¥ x (Xq = x) = 1 for all x G E. 

Then, X is also a multiparameter Markov and Feller process with respect to the filtration 
(J-" t ) teR jv and with the following transition operators T = {T t ; t G R+ }, 

Mt G R + , V/ : R ->• R + measurable; 7 t f = P[o,t]\{o}/- 

Proof. We have to check the different points of the previous definition of multiparameter Markov 
processes. 

(i) X is clearly adapted to {J r t)teJi N > 

(ii) X is right-continuous P x -a.s. according to Theorem 3.1; 
(Hi) (J r t)teR™ is a commuting filtration using Theorem 2.3; 
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(iv) for all s,t £ R+ and for all / £ Cq{E), we have P x -a.s. 

Ex[/(X t+s ) | -F s ] = P[o,t+ s ]\[o, s ]/(^ s ) since X is C-Markov 

= P[o 1 t]\-ro}/(-^s) since V is homogeneous 

:=7 t /(X s ); 

(v) for all i£R, the hypotheses state that ¥ x (Xo = x) = 1. 

Finally, the Feller hypotheses on T are easily verified using equation (2.16) and Definition 2.13 
of a Feller C-transition system. □ 

As stated in [26], the family of operators 7 characterizes the two-dimensional marginals of 
X, but it is not known if it determines entirely the law of X. Proposition 3.2 partially answers 
this question since when X is also C-Markov, we know that the larger family V of transition 
probabilities completely characterizes the finite-dimensional distributions of X. 

Since it is not known whether the multiparameter Markov property gives a complete picture 
of the law of a process X, it is not possible to obtain a general result which would state that 
multiparameter Markov processes are also C-Markov. Nevertheless, we show in the following 
examples that classic multiparameter Markov processes considered in the literature are also 
C-Markov. 

Example 3.1 (Additive Levy processes). An additive Levy process X = {X t ; t £ R+} is 
defined by 

Vt£R^; X t = Xl+---+Xg. 

where X 1 , . . . , X N are N independent one-parameter Levy processes. As explained in [26], X 
is a multiparameter Markov process. 

To check the C-Markov property, we observe that for any increment C £ C, 

AX c = AX 1 Cl +--- + AXg N , 

where Cj = CHe^ and e\ = RxfO} 1 *" 1 , . . . , ejv correspond to the natural axis in K N . Therefore, 
X has independent increments and is C-Markov. Furthermore, transitions probabilities have the 
following form, for all C = A \ B £ C, 

p c (x c ;r) = (^ Al(Cl) * ■ ■ ■ * v x n i{Cn) ) (r - Ax B ) 

where T £ B(R d ) 7 Ai denotes the Lcbcsgue measure in R and v\, . . . , z/jv are the infinitely 
divisible probability measures which characterize X 1 , . . . , X N . V is also an homogeneous Feller 
C-transition system. 

We remark that X is not necessarily a set-indexed Levy process (as defined in Example 
2.2), unless according to Theorem 4.3 in [20], there exists a measure v and a\, . . . , in R+ 
such that v = v^ 1 = ■ ■ ■ = v^ N . In this specific case, for all C £ C, we obtain Pc(*-c]T) = 
y m a (c) j-p _ ^ x B ) ^ w h ere the measure m a is defined by 

N 

VA£B(R W ); m a {A)=^a i \i{e l ^A). 

i=l 
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In particular, we note that the additive Brownian motion corresponds to a set-indexed Brownian 
motion based on the measure m a with a = (1, . . . , 1). 

Conversely, set-indexed Levy processes are not necessarily additive and multiparameter 
Markov processes. The simplest illustration of that class of processes is the Brownian sheet, 
which corresponds to a set-indexed Brownian motion based on Lebesgue measure. 

Example 3.2 (Product processes). Let consider m independent multiparameter Markov 
and C-Markov processes X % = {XI; t £ R+ }, R di -valued. Then, the product process X is 
defined by 

Vt = t 1 ®---®t m e ; X t = X} 1 ®---® X™, 

where M = M\ + . . . + M m . X is known [26] to be a multiparameter Markov process. Let prove 
it is also C-Markov. 

We define the subsets Si,...,S m of R M as following: Si = R dl x {0} d2 x • ■ ■ x {0}<S 
5*2 = {0} dl x R d2 x {0} d;i x ■ • • x {0} dm , . . . Similarly to additive Levy processes, we remark 
that for all C £ C, 

AX C = AX^ 1 ® ■ • • ® AX£ l m , 

where Ci corresponds to C fl Si, for each i € {1, . . . , to}. 

Therefore, using the independence, the study of an increment AXq can be reduced to 
the study of coordinate processes X 1 , . . . , X m . In particular, since these satisfy the C-Markov 
property, so does X. Its C-transition system V is given by, for all C = A \ B £ C, 

P c (x c ; dx A ) = (x Cl ; dx Al )®---®Pc m (xc ra ; dx A J, (3.3) 

where Pq refers to the C-transition probabilities of X 1 . Furthermore, when the components 
{X l )i< m arc (C-)Feller processes, X is also (C-)Feller. 

,2 

L + 

Vi£R2; Y t = Bl®Bl 

where B 1 and B 2 are two independent Revalued Brownian motion. Equation (3.3) induces 
that the Markov kernel V is characterized by the following densities, for all C £ C, 



The bi-Brownian motion Y = {Y t ; t £ R^} is a simple illustration of this class of processes: 



Pc(x c ; ( M ® v)) = — , exp 



=k!l 2 II^-A4JI 2 



(2Tr) d (X 1 (C 1 )X 1 (C 2 )) d / 2 ^\ 2Ai(d) 2Ai(C a ) 

Example 3.3 (Multiparameter Ornstein-Uhlenbeck processes). As proved in [6], on 
the space (T,A,m a ), the Gaussian set-indexed Ornstein-Uhlenbeck process has the following 
integral representation: 



yt £ r; v ; x, 



N. y\ = e -< Q . 4 ) 



X + <t e {a > u} dW u 

J(—oo,t]\(— oo,0] 



where a > 0, a = (ai, . . . , o-n) £ R w with on > 0, W is the Brownian sheet and X$ is a 
random variable independent of W. 

A different, but also natural, multiparameter extension of the Ornstein-Uhlenbeck process 
has been suggested in the literature (e.g. see [42, 43] and [17]). It is defined by, 



Vt £ R+ ; Y t = e- (Q ' 4> 



Y + a \ e^ u) dW u 
J[o,t] 
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As shown in [43], Y is an *-Markov process in the two-parameter case. A calculus similar to 
Proposition 2.5 from [6] proves that it is also C-Markov. Furthermore, if V and V respectively 
denote the C-transition system of X and Y, we observe that 



S AxB (dx A ) for all CeC s.t. CCS; 
Pc{x C ]dx A ) for all CeC s.t. C n S = 



where the set S corresponds to {t G R+ : JliLi ^ = 0} 
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